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All children born in Manitoba in 1984 were tracked for 18 years to assess their grade- 
12 performance on a provincial examination according to a student's socio-economic 
status. The proportion of youths in families receiving social assistance judged to have 
passed their language arts exam dropped from 80 per cent to 12 per cent, depending 
on whether one counts only those in the cohort who took the test on time in 2002 or 
all youths born in 1984 who should have taken the test in 2002. Getting better data on 
performance and doing something about the discrepancies should become a 
Canadian priority. 
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Tous les enfants nes au Manitoba en 1984 ont ete suivis sur une periode de 18 ans en 
vue d'evaluer leur rendement en 12*' annee lors d'un examen provincial, tenant 
compte de -leur statut socioeconomique. La proportion de jeunes issus des families 
recevant de Taide sociale et consideres comme ayant reussi leur examen au plan des 
competences linguistiques passe de 80 % a 12 %, selon que Ton compte seulement 
ceux qui, dans la cohorte, ont subi Texamen a temps en 2002 ou tous les jeunes nes en 
1984 qui auraient du subir Texamen. En matiere d'egalite des chances, la 
performance du systeme scolaire actuel au Canada laisse a desirer. 

Mots cles : possibilites educatives, resultats d' examen, statut socioeconomique, 
analyse longitudinale. 
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Reports comparing educational test results across different schools 
within a region (Most, 2003), across regions (Bussiere et al., 2001; 
Canadian Education Statistics Council, 2003; Willms,1997; Wirt, Choy, 
Provasnik, Rooney, & Tobin, 2003) and across countries (Organization 
for Economic Co-perafion and Developmenf [OECD], 2001; Marfin ef al., 
2000; Mullis ef al., 2000) are now common. Elowever, fesfing fells only 
parf of fhe story. Exam resulfs illusfrafe fhe performance of individuals 
faking fhe fesfs, only children enrolled in schools in one parficular grade 
are assessed, fhose children who have made if far enough in fhe sysfem 
to be examined. Whaf is nof known is how many sfudenfs missed a fesf 
because fhey were nof in school on fesf day, because fhey had fallen one 
or more years behind fheir cohorf, or because fhey had dropped ouf. 
Raudenbush and Kim (2002) suggesf fhaf fhe mosf imporfanf 
shorfcoming of cross-nafional dafa comparisons is bias in how 
populafions are defined, for example "by fhe meaning of 'grade' in fhe 
presence of refenfion or selecfive dropouf" (p. 292). Programme for 
Infernafional Sfudenf Assessmenf (PISA, 2000) deal! wifh fhe failure-fo- 
progress issue in a relafively sophisficafed manner, focusing on exam 
achievemenf of 15 year olds (acfually fhose who were enrolled in school 
and 15 years and 3 monfhs to 16 years and 2 monfhs af fhe sfarf of fhe 
assessmenf period), regardless of fheir sfanding in a school sysfem 
(OECD, 2001, p. 231). However, only 88 per cenf of fhe Canadian schools 
originally sampled agreed to parficipafe (56 per cenf of American 
sampled schools agreed), and sfudenfs in fhe sampled schools in bofh 
counfries showed a 15 per cenf non-parficipafion rate (OECD, 2001, p. 
235). The resulfs were weighfed to accounf for non-responders wifhin 
schools and for non-parficipafing schools, buf fhese weighfings did nof 
accounf for fhe likelihood fhaf fhe non-assessed populafion had lower 
fesf scores. 

Educafional performance is repeafedly shown fo be sfrongly 
associated wifh fhe socio-economic characferisfics of a child's 
neighborhood (Ainsworfh, 2002) and wifh fhe relafive levels of 
educafion, income, and occupafion of fhe family in which a child is 
raised. Indeed, socio-economic sfafus remains fhe single mosf powerful 
predicfor of educafional and ofher life oufcomes (Gorard, Eifz, & Taylor, 
2001; Ma & Klinger, 2000). 
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The same factors that predict poor performance also predict dropout 
rates, absenteeism, and grade retention (Audas & Willms, 2001; Fields & 
Smith, 1998; Haveman & Wolfe, 1994). The question arises: does typical 
reporting of education test results underestimate the relationship 
between socio-economic status and educational outcomes? Schools 
themselves have little information on what happens to children who do 
not register: have they enrolled in another school, left the region, or 
dropped out? 

Population-based data such as those in Manitoba, and similar 
resources available elsewhere in Canada such as British Columbia 
(Chamberlayne et al., 1998), are invaluable for giving a more accurate 
assessment of educational attainment across at-risk groups. The 
Manitoba data available for this project provided an essentially complete 
registration and follow-up of a population of 1.1 million individuals 
from the early 1970s (Roos et al., 1996). We have used these data to 
follow all children bom in Manitoba in 1984, who remained in the 
province for 18 years (80%), to assess their educational achievement 
according to key socio-economic risk factors: membership in a family 
receiving social assistance, affluence of neighborhood of residence, and 
maternal age at child's birth. 

METHOD 

The Population Health Research Data Repository held at the Manitoba 
Centre for Health Policy has been built over the last 25 years with the 
cooperation of the Ministries of Health, Education, Citizenship and 
Youth, and Family Services and Housing. This database includes 
information on all children bom in the province. We took birth 
information and mother's age at the time of the birth of the child from 
universal hospital discharge abstracts. A population research registry 
permits identifying whether an individual has left the province or, if an 
individual remains, specifying place of residence at various points in 
time (Roos & Nicol, 1999). The database also includes information on all 
students enrolled in schools in Manitoba and information from the 
provincial standard tests taken in grade 12. These tests contribute 30 per 
cent to students' final course mark. Individuals pass the language arts 
test by scoring 50 per cent or more on any of the following exams: 
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English, French as a second language (students in the French immersion 
program), and French as a primary language. Individuals pass the 
mathematics test by scoring 50 per cent or better on the pre-calculus 
exam, the consumer math exam, or the applied math exam. Because the 
type of math exam taken is also related to socio-economic status (24 per 
cent of grade-12 sfudenfs in fhe highesf income neighborhoods fake fhe 
pre-calculus fesf compared fo seven per cenf of fhose in fhe lowesf 
income neighborhoods), fhe measure "per cenf passing fhe mafh fesf" 
underesfimafes socio-economic differences in achievemenf. 

Of fhose children born in Manitoba in 1984, 80 per cenf were residenf 
in fhe province in June 2002. The 20 per cenf of fhe cohorf who leff fhe 
province befween 1984 and 2002 were slighfly more likely fo have had 
older mofhers and were somewhaf more likely fo have been residenfs of 
fhe pooresf neighborhoods in fhe census year, 1986 (24 per cenf versus 20 
per cenf). Because socio-economic sfafus in neighborhood of residence 
may be more meaningfully defined in urban areas, we resfricfed our 
analyses fo cohorf members residenf in Winnipeg in 2002. Abouf eighf 
per cenf (approximately 500 youfhs) of our cohorf have Treafy Firsf 
Nafions (Aboriginal) sfafus. These individuals fend fo have poorer 
economic sfafus and educafional oufcomes (Canadian Educafional 
Sfafisfics Council, 2003; Indian Affairs and Norfhern Developmenf, 
2000). To facilifafe generalizafion fo ofher jurisdicfions, Treafy Firsf 
Nafions youfh living in Wirmipeg (N = 282) were excluded from fhis 
analysis. Our mefhod for excluding Firsf Nafions youfh misses 
approximafely half of such individuals; hence, perhaps 4 per cenf of fhe 
analyzed cohorf (250 of fhe 5894 youfhs) were Firsf Nafions. A few 
cohorf members (69) were advanced a year and graduafed before 2002, 
fhe year fhey would have been expecfed fo fake fhe exam; fhese 
individuals and fhose who had died are nof included in fhe analysis. 
Sfudenfs enrolled in privafe and parochial schools in Wirmipeg were 
included. After all exclusions, 5894 youfhs bom in Manifoba in 1984 
were available for fhese analyses. 

If fhese individuals had proceeded fhrough school on fhe usual 
course wifh ofhers born fhaf year, fhey would have been wrifing fhe 
grade-12 sfandard fesfs in January or June 2002, and graduafing in June 
2002. We assessed achievemenf nof only by whefher fhe sfudenf passed 
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the test, but also by whether the student was absent or did not complete 
the test, had dropped back one or more years (so in 2001/02 was enrolled 
in grades 9, 10 or 11), or had dropped out of school entirely. To clarify 
fhe presenfafion, 2002 is used subsequenfly in fhe fexf when 
exam/graduafion dafes are mentioned. 

Record linkage befween fhe research regisfry and fhe educational 
enrollmenf file enabled us fo identify fhose from fhe cohorf who were in 
fhe province buf nof enrolled in school (Black & Roos, 2005). Qualify of 
fhe linkage was high. Jusf 2.8 per cenf of fhe sfudenfs enrolled in school 
in 2002 could nof be linked fo fhe regisfry as of fhe end of December 
2001. Of fhis small group, a cerfain per cenf age would nof be expecfed fo 
be in fhe regisfry. These included foreign sfudenfs, Canadian sfudenfs 
moving fo Manifoba whose healfh coverage had nof yef been fransferred 
from fheir home province, and immigranf sfudenfs nof yef eligible for 
Manifoba coverage. Hence, we assumed fhaf cohorf members identified 
by fhe regisfry as residenf in fhe province, buf nof found in fhe 
enrollmenf file, were accurafely identified as wifhdrawn from school. A 
very small number of youfhs from higher income families leaving fhe 
province for boarding school were inappropriately categorized as having 
dropped out of school, lowering fhe measured success rafes for high-SES 
sfudenfs. 

Alfhough some parenfs may deliberafely hold fheir children back a 
year af school enfry, an analysis of children in kindergarfen in 1998/99 
fhrough 2002/03 showed fhaf fhis occurred for only 2.05% of Winnipeg 
children. However, children born in December (and, fo a lesser exfenf, 
November) are considerably more likely fhan fhose bom earlier in fhe 
year, fo be in Grade 11 or lower af fhe "age appropriafe" time. Much of 
fhis discrepancy is likely due fo cuf-off dafes for school enfry. Some 
children born in November and December would sfarf school wifh fheir 
birfh cohorf and some would sfarf fhe following year. Analyses 
eliminating fhose bom in December were compared wifh fhose 
including all 12 monfhs; small (1-2%) differences in frequencies were 
nofed; if anyfhing fhey accenfuafe fhe gradienfs across socio-economic 
groups in achievemenf. 

To measure socio-economic sfafus, public-use dafa from fhe 2001 
Canadian Census were aggregafed af fhe geographic unif of fhe 
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dissemination area; a dissemination area had a population of 400 to 700 
persons. The areas were ranked from highesf fo lowesf income and fhen 
grouped info five population quintiles; each quintile confained 
approximafely 20 per cenf of fhe urban populafion.i Each individual was 
assigned fo a disseminafion area according fo his or her residenfial posfal 
code in 2001, and each disseminafion area was cafegorized as belonging 
fo one of five income quinfiles based on average household income for 
area residenfs. A similar fechnique classified areas and children in 1986. 
The ordering of neighbourhood income was quife sfable, wifh 
correlations around .85 over five year census infervals. Manitoba sfudies 
using self-reporfed household income showed resulfs on healfh sfafus 
measures quife similar fo fhose using neighbourhood income (Musfard, 
Derksen, Berfhelof & Wolfson, 1999). Individuals were also cafegorized 
according fo whefher fheir family received social assisfance in fhe recenf 
pasf, defined as having received one or more monfhs of income supporf 
over fhe fwo-year period, 2000-2001. 

RESULTS 

Population- versus Grade-based Performance 

The leff-hand parf of Table 1 highlighfs fhose individuals from fhe 1984 
cohorf writing fhe grade-12 exams in 2002. Overall, 89 per cenf of fhose 
faking fhe language arfs fesf (3,368 individuals) passed, while 76 per cenf 
of fhose writing one of fhe mafhemafics fesfs (2,526 individuals) passed. 
Elowever, fhese resulfs reporf only fhe performance of fhose bom in 
1984, reaching grade 12 by 2002, and completing fhe exam. The righf- 
hand half of Table 1 fells fhe complefe story. This parf of fhe fable 
includes all cohorf members living in Manifoba in 2002, nof jusf fhose 
wrifing fhe exam on fime. This more accurate picfure identifies fhe 14 
per cenf of fhe cohorf who had dropped fhe course before wrifing fhe 
language arfs fesf, were absenf on fhe day of fhe fesf, or did nof complefe 
if, fhe 13 per cenf of fhe cohorf af leasf one grade behind, and fhe 8 per 
cenf of fhe cohorf who had dropped ouf of school completely, leaving 
jusf 57 per cenf who passed. When fhe mafhemafics fesf resulfs are 
analyzed in fhe same way, a similar picfure emerges; only 43 per cenf 
passed. 
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Table 1: Grade 12 Standard Test Performance 



Cohort Students Writing 
Test* 

Entire 18 Year Cohort** 

Language Arts 
Test 

N 

Percent 

N 

Percent 

Passed 

3,368 

89% 

3,368 

57% 

Failed 

415 

11% 

415 

7% 

Absent/Dropped 



850 

14% 

Enrolled Grades 9- 

11 



792 

13% 

Not Enrolled 



469 

8% 






Number of 

Individuals 

3,783 


5,894 







Math Test 





Passed 

2,526 

76% 

2,526 

43% 

Failed 

808 

24% 

808 

14% 

Absent/Dropped 



1,299 

22% 

Enrolled Grades 9- 

11 



792 

13% 

Not Enrolled 



469 

8% 






Number of 
Individuals 

3,334 


5,894 



‘Includes all those born in Manitoba 1984, resident in Winnipeg in June 2002 who wrote 
standard test in 2002. 

“Includes all those born in Manitoba in 1984 and resident in Winnipeg in June 2002 
regardless of whether they wrote the test or not. 

Performance by Socio-economic Indicators 

The full impact of this more accurate perspective emerges from 
examining performance by our three socio-economic indicators: family 
receipt of social assistance, affluence of neighborhood of residence, and 
age of the mother at her child's birth. Approximately 9 per cent of the 
2002-resident cohort (538/5894) were members of families receiving 
social assistance, but only 2.2 per cent of the test writers were in such 
families. The proportion of youths in families receiving social assistance 
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judged to have passed their language arts exam drops from 80 per cent 
to 12 per cent, depending on whether we counted only those taking the 
test on time or all children born in 1984 who should have taken the test 
(Table 2). The mathematics test shows essentially the same pattern 
(Table 2), with the pass rate dropping from 76 per cenf fo 10 per cenf. 

Table 3 assesses performance according fo fhe relafive affluence of 
fhe neighborhood of residence in 2002, fhe year during which fhe exam 
would have been written had individuals been in fhe age-appropriafe 
grade. Among fesf wrifers, fhe language arfs pass rafe ranges from 85 
per cenf fo 92 per cenf, while fhe mafh pass rafe ranges from 70 per cenf 
fo 79 per cenf. For fhe enfire cohorf, fhough, pass rafes for fhe pooresf 
neighbourhoods are less fhan half fhose in fhe wealfhiesf (33% versus 
72% for language arfs, 23% versus 52% for mafh). Nof only did fhe pass 
rafes fall, buf fhe gradienf befween higher and lower income areas gefs 
considerably sleeper using fhis fruer perspecfive. 

Taking relafive affluence of neighborhood of residence when fhe 
child was fwo years old (in 1986) for describing performance produces 
similar resulfs^. Performance by mafemal age af fhe fime fhe child was 
born also differs dramafically depending on whefher only fhose wrifing 
or all fhose who should have written are considered (Table 4). Among 
fesf wrifers, 78 per cenf of fhe children of feenage mofhers passed fhe 
language arfs fesf compared wifh 90 per cenf of fhe offspring of older 
mofhers. For fhe enfire cohorf, however, fully 25 per cenf of children 
born in 1984 fo feenage mofhers had dropped ouf of school, 33 per cenf 
had been refained af leasf one grade, and 13 per cenf were eifher absenf 
on fhe day of fhe tesf or had dropped fhe course. Only 22 per cenf of fhis 
cohorf passed fhe fesf, compared fo 64 per cenf of fhose youfh whose 
mofhers were 25 years or older af fhe fime of fhe child's birfh. Similar, 
slighfly sfronger resulfs are obfained by using mafemal age af fhe time of 
fhe birfh of a mofher's firsf child. 
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Table 2: Standard Test Performance and Social Assistance 



Cohort Students Writing Test 
Received Social Assistance 

Entire 18 Year Cohort 

Received Social Assistance 


Yes“ 

No““ 

Yes“ 

No*“ 


N 

o/ 

/o 

N 

o/ 

/o 

N 

% 

N 

% 

Language 
Arts Test 


■ 


■ 





Passed 

67 

80% 

3,301 

89% 

67 

12% 

3301 

62% 

Failed 

17 

20% 

398 

11% 

17 

3% 

398 

7% 

Absent/ 

Dropped 


■ 


■ 

94 

18% 

756 

14% 

Enrolled 

Grades 9-11 


■ 


■ 

215 

40% 

577 

11% 

Not 

Enrolled 


■ 


■ 

145 

27% 

324 

6% 










Number of 

Individuals 

84 

■ 

3,699 

■ 

538 


5,356 


X 2=7.55 p=0.0006 

X 2=801.8 p<0.0001 


Math Test 









Passed 

55 

76% 

2,471 

76% 

55 

10% 

2,471 

46% 

Failed 

17 

24% 

791 

24% 

17 

3% 

791 

15% 

Absent/Dro 

pped 


■ 


■ 

106 

20% 

1,193 

22% 

Enrolled 

Grades 9-11 


■ 


■ 

215 

40% 

577 

11% 

Not 

Enrolled 


■ 


■ 

145 

27% 

324 

6% 










Number of 

Individuals 

72 


3,262 


538 


5,356 


X 2=0.016 p=0.006 

X 2=775.1 p<0.0001 


“■Includes children in families receiving social assistance from the province for one or more 
months over the period 2000 - 2001. 

“■“Includes everyone else in the cohort as defined in Table 1. 

The Pearson chi-square statistic (reported tor each of the 4 components in the above table) 
collectively compares the observed cell frequencies with the expected frequencies under 
the assumption of no association between the row and column variables in the table. When 
the p-value is less than 0.01 we conclude that there is a statistically significant association. 
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Table 3: Standard Test Performance 2002 by Students' Neighborhood of Residence 



Cohort Students Writing Test 
Neighborhood of Residence 

Entire 18 Year Cohort 
Neighborhood of Residence 


Ql 

Poor 

-est 

Q2 

Q3 

Q4 

Q5 

Wealth 

-iest 

Ql 

Poor 

-est 

Q2 

Q3 

Q4 

Q5 

Wealth 

-iest 

Language 
Arts Test 
(percent) 






■ 

■ 

■ 

■ 


Passed 

87% 

86% 

85% 

89% 

92% 

33% 

45% 

54% 

62% 

72% 

Failed 

13% 

14% 

15% 

11% 

8% 

5% 

8% 

9% 

8% 

6% 

Absent/ 

Dropped 






15% 

16% 

15% 

15% 

12% 

Enrolled 

Grades 9- 

11 






27% 

20% 

14% 

10% 

7% 

Not 

Enrolled 






20% 

11% 

9% 

5% 

3% 

Number of 

Indivi- 

duals 

343 

380 

631 

1,048 

1,381 

909 

719 

1,003 

1,504 

1,759 

1 X 2=27.8 p<0.0001 

X "=689.4 p<0.0001 1 












Math Test 
(per cent) 











Passed 

70% 

71% 

73% 

79% 

77% 

23% 

32% 

40% 

51% 

52% 

Failed 

30% 

29% 

27% 

21% 

23% 

10% 

13% 

15% 

14% 

16% 

Absent/ 

Dropped 






20% 

23% 

23% 

21% 

23% 

Enrolled 

Grades 9- 

11 






27% 

20% 

14% 

10% 

7% 

Not 

Enrolled 






20% 

11% 

9% 

5% 

3% 

Number 

of Indivi- 
duals 

298 

329 

550 

966 

1,191 

909 

719 

1,003 

1,504 

1,759 

X M8.7 p=0.0009 

X "=655.4 p<0.0001 1 


The Pearson chi-square statistic (reported above) collectively compares the observed cell 
frequencies with the expected frequencies. When the p-value is less than 0.01 we conclude 
that there is an association between the row and the column variables in the table. 
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Table 4: Standard Test Performance by Age of Mother at Birth of the Cohort Child 



Cohort Students Writing 
Test 

Mother's Age in 1984 

Entire 18 Year Cohort 
Mother's Age in 1984 


<=19 

20-24 

25+ 

<=19 

20-24 

25+ 

Language Arts 
Test (per cent) 







Passed 

78% 

85% 

90% 

22% 

43% 

64% 

Failed 

22% 

15% 

10% 

6% 

7% 

7% 

Absent/Dropped 




13% 

18% 

14% 

Enrolled Grades 

9-11 




33% 

19% 

10% 

Not Enrolled 




25% 

13% 

5% 

Number of 

Individuals 

87 

655 

3,041 

308 

1,297 

4,289 

X 2=23.4 p<0.0001 

X 2=503.1 p<0.0001 


Math Test (per 
cent) 







Passed 

70% 

74% 

76% 

15% 

33% 

48% 

Failed 

30% 

26% 

24% 

7% 

12% 

15% 

Absent/Dropped 




20% 

24% 

22% 

Enrolled Grades 

9-11 




33% 

19% 

10% 

Not Enrolled 




25% 

13% 

5% 

Number of 
Individuals 

67 

572 

2,695 

308 

1,297 

4,289 

X 2=2.85 p=0.2410 

X 2=482.5 p<0.0001 


The Pearson chi-square statistic (reported above) collectively compares the observed cell 
frequencies with the expected frequencies. When the p-value is less than 0.01 we conclude 
that there is an association between the row and the column variables in the table. 


Taking a Closer Look 

The above data reflect movement of fhe 1984 cohorf fhrough fhe 
educafional sysfem buf somewhaf misrepresenf how cross-secfional 
differences would fypically be reporfed across advanfaged and 
disadvanfaged groups. In any given year, fhose faking an examination 
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will include students who have been retained one or more years. These 
retained individuals have a higher probability of failure; hence fhe 
differences typically observed in any given year across the socio- 
economic groups will be somewhat larger than is seen in our one-year 
perspective based on the birth cohort. For example, excluding Treaty 
First Nations youth but including all those taking the language arts test 
in 2002 (not just those bom in 1984) changes the range of differences. 
The language arfs pass rafe range for sfudenfs in social assisfance 
families, versus fhose nof, is 73 fo 87 per cenf passing (compared wifh 80 
fo 89 per cenf in Table 2), and 80 fo 91 per cenf for fhose residenf in fhe 
pooresf versus fhe wealfhiesf neighborhoods (compared wifh 87 fo 92 
per cenf in Table 3). 

We have assumed fhaf fhose nof participating in fesfing would have 
performed more poorly fhan fhose faking fhe exam. Is fhis fair? Our besf 
measure of educafional achievemenf for high school sfudenfs is "do fhey 
graduafe?" Our cohorf of 5894 youfhs, sfarfing wifh fhe year fhey 
enfered grade 9, was hacked for up fo six years fo defermine whaf 
happened fo fhe fesf-fakers and fhe non-fakers. Almosf all fhose who 
passed fhe exam wenf on fo graduafe (90%). Those nof parficipafing in 
fesfing were much less likely fo graduafe wifhin fwo years of the test 
than those who wrote and failed. Sevenfy-six per cenf of fhose failing 
fhe exam graduafed wifhin fwo years compared fo 32 per cenf of fhose 
absenf on fhe fesf day, 19 per cenf of fhose held back one grade or more, 
and only fhree per cenf of fhose nof enrolled. 

Multivariate Analyses of Factors Related to Achievement 

We used logistic regression fo examine fhe simulfaneous impacf of fhe 
various factors on a sfudenf's probabilify of passing fhe language arfs 
tesf. These resulfs are presented in Table 5. Among fesf-fakers and for fhe 
entire cohorf, males are approximately half as likely fo pass fhe fesf as 
females, and sfudenfs whose mofher was very young (17 years or less) af 
fheir birfh were much less likely fo pass fhan sfudenfs whose mofher had 
been 25 years or older. ITowever, fesf-fakers differ from fhe enfire cohorf 
in mosf ofher respecfs. Among fesf fakers, neighbourhood of residence 
did nof appear fo make much difference, buf for fhe enfire cohorf. 
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Table 5: The Odds of Passing Language Arts Test 



Cohort Students Writing 
Test* (N=3783) 

Entire 18 Year Cohort** 

(N=5894) 


Odds 

Ratio 

Confidence 

Limits 

Odds 

Ratio 

Confidence 

Limits 

Sex 





Male/Female 

.49 

(.40-.61) 

.54 

(.49-.61) 






Mother's Age in 1984 





< 17 vs 25 "^ears + 

.24 

(.10-.59) 

.24 

(.13-.43) 

18-19 

.60 

(.31-1.19) 

.29 

(.21-.41) 

20-24 

.69 

(.54-.89) 

.57 

(.50-.66) 

Received Income 

Assistance 





Yes/No 

.60 

(.34-1.06) 

.15 

(.12-.20) 






Neighborhood of 
Residence 





Q1 (Poorest) vs. Q5 
(Wealthiest) 

.65 

(.44-.95) 

.33 

(.27-.40) 

Q2 

.56 

(.40-.81) 

.45 

(.37-.54) 

Q3 

.52 

(.38-.70) 

.54 

(.45-.63) 

Q4 

.69 

(.52-.91) 

.67 

(.57-.78) 


“■The area under the ROC (receiver operating characteristic) curve was 0.64 in this logistic 
regression. Model calibration showed a good fit between estimated and actual values; the 
Hosmer Lemeshow goodness of fit test was insignificant (p=.41 = 6.13 and 6 d.f) 

“■“■The area under the ROC (receiver operating characteristic) curve was 0.71 in this logistic 
regression. Model calibration showed a good fit between estimated and actual values; the 
Hosmer Lemeshow goodness of fit test was insignificant (p=.50 = 6.35 and 7 d.f) 


differences were sfriking; fhe pooresf neighbourhood sfudenfs were only 
one fhird as likely fo pass fheir language arfs fesf as fhe wealfhiesf- 
neighbourhood sfudenfs. Youfhs in families receiving social assisfance 
face even harsher challenges (alfhough again fhis is nof apparenf from 
fhe fesf-fakers). Focusing on fhe enfire cohorf, for youfhs in families 
receiving assisfance fhe odds of passing fhe language arfs fesf af fhe age 
appropriafe fime were 85 per cenf lower fhan fhe odds for youfhs in 
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families not receiving assistance, even after controlling for the other 
factors (sex, mean household income in neighborhood of residence, and 
mother's age at the birth of the child.) 

The differences in achievement documented here could not have 
been predicted from common biomedical measures used to evaluate 
children at birth. Low birth weight babies are at risk for a number of 
developmental, cognitive, and health problems, and babies with low 
Apgar^ scores are at increased risk of later health and developmental 
problems. However, both the percentage of children with normal birth 
weight and the percentage with normal Apgar scores varied little across 
the different socio-economic groups we review here (Brownell et al., 
2004). 

DISCUSSION 

This article shows the clear advantage of approaching educational 
achievement from the population perspective. The Manitoba Population 
Health Data Repository provides great potential for other such 
investigations, both those driven by researchers and those suggested by 
provincial ministries. Routinely collected administrative data facilitate 
measurement of several types of variables, those relating to individuals, 
families, neighborhoods, and schools. Information on health, including 
measures of mental health, over the life course, can be tracked. Poor 
child health will influence educational achievement (Alderman, 
Behrman, Lavy, & Menon, 2001), while parental disability has been 
shown to be a significant negative predictor of a child's educational 
attainment (Haveman & Wolfe, 1994). Variables pertaining to marital 
status, family size, and family structure can be assessed at any point in 
time using the registry. 

Information on place of residence over time can highlight potentially 
disruptive effects of change of residence, can be used to estimate 
socioeconomic mobility, and to assess the effects of length of exposure to 
particular kinds of neighborhoods. Both compositional and contextual 
neighborhood information are available (MacIntyre & Ellaway, 2003). 
The Canadian census, carried out every five years, provides a wealth of 
data on each dissemination area, which can be aggregated upward to 
larger areas (Martens, Frohlich, Carriere, Derksen & Brownell, 2002). 
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Extensive contextual information on recreational programs, crime rates, 
and housing characteristics has been gathered for urban neighborhoods. 
Finally, various types of informafion on schools are being incorporafed 
info fhe dafabase. 

The longifudinal dafa (up fo 34 years worfh) on individuals and 
families are parficularly rich. Haveman and Wolfe (1994) have suggesfed 
sfudies of siblings can help deal wifh fhe pofenfial bias by confrolling 
common family background characferisfics such as parenfal aspirafions 
or mofivafion. For example, sibling analyses fend fo lead fo smaller 
esfimafes of fhe effecfs of feen ferfilify (Ribar, 1999). Designs combining 
siblings and neighbors are especially appropriafe because "parallel 
analyses for children growing up in fhe same neighborhood buf nof in 
fhe same family can indicafe how much of whaf is imporfanf in fhe 
shared environmenfs of siblings lies oufside fhe immediafe family" 
(Duncan & Raudenbush, 2001, p. 363). Wifh grade-12 examinafion 
resulfs currenfly available for seven years (from years 1995-2002, wifh 
2000 missing), performance dafa for large numbers of bofh siblings and 
non-siblings can be analyzed. 

ASSESSING PERFORMANCE 

We infroduce fhese dafa fo educafional groups wifh fhe following: 
"None of whaf you're abouf fo see is surprising, yef you'll be surprised," 
followed by "The role of research is fo affach numbers fo fhe obvious, fo 
make if undeniable." The Manitoba dafa emphasize fhe remarkably 
differenf levels of educafional achievemenf across socio-economic 
groups. They also confirm fhaf assessmenfs of educafional achievemenf 
nof capfuring fhe entire populafion of children who should be faking fhe 
fesf will overestimate fhe performance of groups af risk for poor 
oufcomes and provide disforfed, inaccurate comparisons of school 
performance. The 95 per cenf parficipafion requiremenf of fhe No Child 
Leff Behind fesfing program (U.S. Depf. of Education, 2006) is a sfep in 
reducing selecfivify bias buf does nof solve fhe problem. By ignoring 
fhose nof af fheir age appropriafe grade level and fhose who have 
dropped ouf, SES differences in performance are markedly 
underestimated . 
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Samples in international comparative studies often have trouble 
reaching low achievement schools; even the schools responding miss 
those children (mostly of lower socio-economic sfafus) who have leff 
school, failed fo be promofed, failed fo complefe fhe exam, or are absenf 
on fhe day of fhe fesf. Panel surveys are also likely fo under-represenf 
fhe gradienf in oufcomes. They typically draw few families from high 
poverfy urban neighborhoods (Shonkoff & Phillips, 2000), and children 
from such families who respond inifially are more likely fo be losf fo 
follow up. Finally, individuals also fend fo under-reporf risk facfors and 
oversfafe achievemenf; Sfafisfics Canada's Survey of Labour and Income 
Dynamics (SLID) markedly undersfafes bofh welfare dependence in 
Brifish Columbia and oversfafes high-school complefion by welfare 
recipienfs (Warburfon & Warburfon, 2004). 

An educafion reform sfrafegy fhaf relies mainly on cross-secfional 
fesfing fo idenfify and label problem schools will grossly underesfimafe 
fhe performance advanfage provided by higher socio-economic sfafus. In 
younger grades, alfhough sfudenfs have nof yef wifhdrawn from school, 
many are likely fo have already fallen behind one or more grades for 
fheir age. Indeed, improper exempfions, absences, and refenfions have 
been hypofhesized fo accounf for fhe increased pass rafe on exams in 
some U.S. sfafes (Heuberf, 2002). In Massachusetts, for example, 
improved pass rafes among fenfh graders in 2001 followed increased 
ninfh-grade refenfion in previous years. Efforfs fo keep adolescenfs of 
lower socio-economic sfafus in school, as well as efforfs fo improve fheir 
performance wifhin fhe school sysfem, are needed. 

There is also a good news sfory in fhese dafa which musf be 
highlighfed. For fhose children who sfay in school and are nof refained, 
fhe differences in achievemenf across socio-economic groups are modesf. 
Programs fhaf keep children from disadvanfaged backgrounds in school 
and progressing fhrough wifh their peers are critically important. 

Manitoba represents a good jurisdiction in which to study this issue. 
Canadian children score better on international comparisons than 
Americans, and Manitobans score at or above the Canadian average 
(Willms, 1997). Winnipeg results are particularly compelling given that 
educational funding per child is relatively equal across areas (Task Force 
on Educational Funding, 2001) wifh some exfra funding going fo schools 
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having more students from low income families (Manitoba Educafion 
and Youfh, 2003). In many U.S. communifies, per pupil spending differs 
markedly according to a child's place of residence wifh much more being 
spenf on more affluenf children. Thus, per pupil public school spending 
in Massachusetts recenfly varied from $5758 fo $6503 in less wealfhy 
communifies such as Worcesfer and Lowell fo $9116 and $9356 in 
affluenf Weston and Carlisle (Mosf, 2003). U.S. schools wifh a larger 
proporfion of poor children are more likely fo have less qualified 
teachers, fo be overcrowded, and fo use buildings in less fhan adequafe 
repair (Evans & Kanfrowifz, 2002). Thus, our picfure of fhe educafional 
experience of Wirmipeg youfh from disadvanfaged backgrounds may 
well be opfimisfic for disadvanfaged youfh in fhe seffings where per 
sfudenf funding is nof af leasf similar across jurisdicfions. 

CONCLUSION 

If is well known fhaf many sfudenfs from lower SES sifuafions do nof do 
well in school. Our research demonsfrafes fhaf "whaf we fhink we 
know," af leasf whaf we derive from convenfionally reporfed grade-12 
sfandard fesf resulfs, sfrongly underesfimafes how poorly lower SES 
sfudenfs perform. These findings challenge fesfing policies for 
monitoring school performance and highlighf fhe imporfance of 
changing fhe frajecfories of disadvanfaged children. Early childhood 
developmenf programs (Shonkoff & Phillips, 2000), year-round 
educafional opporfunifies in disadvanfaged areas (Fischer, Elouf, 
Jankowski, Swidler & Voss, 1996), qualified teachers, and increasing fhe 
educafional affainmenf of fhe nexf generation's parenfs (Elaveman & 
Wolfe, 1994) are likely candidates for successful interventions. If we are 
fo move from a welfare sfafe fo a social invesfmenf sfafe (Giddens, 1998, 
2000, 2001), fhen social invesfmenfs musf be made differenfly. Educafion 
as currenfly functioning in Canada is underperforming as an equalizer of 
opporfunify. 
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NOTES 


' Because the quintiles were developed using total urban population, 
each Winnipeg quintile will not necessarily contain 20 per cent of the high school 
population. 

^ These analyses, as well as those showing performance according to 
family upward or downward mobility, are available from the authors. 

3 Apgar scores measure the physiological well-being of newborn babies. 
A score is given for each of five vital signs: appearance, pulse, reflex, muscle 
tone, and breathing pattern. Very low scores are associated with poor neurologic 
outcomes (Stanley, 1994), whereas borderline scores are associated with 
decreased visual attentiveness in the first year of life (Lewis, Bartels, Campbell, & 
Goldberg, 1967). 
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